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FOREWORD 


The  Leadership  and  Management  Technical  Area  of  the  U.S.  Army  Research 
Institute  (ARI)  is  concerned  with  the  development  of  concepts,  techniques, 
and  training  that  will  enable  the  development  of  increased  efficiency  and 
effectiveness  in  Army  organizational  elements.  One  central  focus  of  this 
work  is  the  internal  operation  of  battle  staffs,  and  the  extent  to  which 
their  performance  or  organizational  processes  essential  to  battlefield  out¬ 
comes  can  be  improved.  The  research  reported  here  applied  a  frame  of  ref¬ 
erence  based  on  systems  theory  to  the  observation  and  feedback  of  battle 
staff  performance  to  the  battle  staff  itself.  It  is  a  part  of  a  larger 
effort  to  determine  whether  training  in  process  performance  will  increase 
battalion  combat  readiness.  The  present  work  was  accomplished  under  con¬ 
tract  MDA903-78-C-2028  with  the  Human  Resources  Research  Organization  and 
is  a  part  of  Army  Project  2Q162717A779 . 
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ORGANIZATIONAL  PROCESS  AND  COMBAT  READINESS:  FEASIBILITY  OF 
TRAINING  ORGANIZATIONAL  STAFF  OFFICERS  TO  ASSESS  COMMAND 
GROUP  PERFORMANCE 


BRIEF 


This  report  describes  the  results  of  the  first  phase  of  a  project  con¬ 
cerned  with  research  on  the  relationship  between  performance  of  certain 
critical  organizational  processes  and  combat  readiness  of  U.S.  Army  units. 
The  research  in  Phase  I  was  devoted  to  (a)  analysis  of  the  relationship  be¬ 
tween  process  performance  of  battalion  command  groups  and  the  combat  out¬ 
comes  of  battle  simulations  in  which  the  battalions  participated  and 
(b)  determination  of  the  feasibility  of  training  Organizational  Effective¬ 
ness  Staff  Officers  (OESO)  to  observe  and  assess  the  process  performance 
of  TOE  unit  battle  staffs  and  to  provide  feedback  of  their  observations  so 
that  improved  performance  would  result.  The  results  of  Phase  I  serve  as  a 
foundation  for  work  to  be  accomplished  in  Phase  II,  which  is  concerned  with 
training  command  groups  and  battle  staffs  to  improve  their  process  per¬ 
formance  and,  thus,  to  enhance  combat  readiness. 


Method: 

Data  were  collected  on  12  battalions  of  the  8th  Infantry  Division  in 
Europe  during  July  and  August  1978.  As  part  of  a  larger  training  exercise, 
the  command  groups  of  the  battalions  participated  in  four  modules  of 
PEGASUS  battle  simulations,  during  which  the  process  performance  of  the 
command  groups  was  observed  and  assessed  by  OESOs.  Following  each  module, 
OESOs  reported  and  discussed  their  observations  with  battalion  commanders 
who,  at  their  discretion,  used  the  feedback  information  to  adjust  pro¬ 
cedures,  roles,  processes,  and  behavior  within  their  command  groups. 

Data  collected  were  (a)  OESO  ratings  of  command  groups  process  per¬ 
formance,  (b)  ratings  of  combat  outcomes  by  opposing  force  controllers, 
and  (c)  interviews  with  OESOs  and  selected  battalion  commanders. 


Results: 

Process  Performance  and  Combat  Outcomes.  A  significant  correlation  of 
.67  was  obtained  between  overall  command  groups  process  performance  and 
overall  combat  outcomes  across  the  four  modules  of  the  battle  simulation. 
This  confirmed  the  expectation  of  a  strong  relationship  between  the  quality 
of  organizations]  process  performance  and  combat  outcomes.  Correlations 
between  the  seven  separate  processes  studied  and  overall  combat  outcomes 
were  in  the  expected  direction  and  were  significant  for  five  of  the  seven. 

Comparisons  between  the  six  battalions  with  the  highest  overall  process 
performance  scores  and  the  six  with  the  lowest  showed  superior  performance 
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by  the  "more  effective"  units  on  all  five  of  the  separate  components  of 
combat  outcomes.  Four  of  these  comparisons  were  significant  (.05,  one- 
tailed  test),  and  one  narrowly  missed  attaining  significance. 


Feasibility  of  Training  Organizational  Effectiveness  Staff  Officers: 

OESOs  were  able  to  identify  the  various  organizational  processes  and 
assess  their  quality  with  little  difficulty  after  training  by  HumRRO  per¬ 
sonnel.  The  results  indicate  that  it  is  feasible  to  train  OESOs  to  assess 
process  performance  and  report  results  of  their  assessments  to  commanders 
and  staffs. 

Interviews  with  OESOs  and  battalion  commanders  produced  a  number  of 
"lessons  learned"  concerning  selection,  training,  and  use  of  OESOs  with 
combat  units.  The  most  outstanding  finding  was  the  firm  conviction  of  both 
OESOs  and  commanders  that  OESOs  must  be  qualified  combat  arms  officers  if 
they  are  to  be  successful  in  helping  to  improve  process  performance  in  com¬ 
bat  units.  Other  implications  and  lessons  learned  are  discussed  in  the 
report . 


Impact  of  Process  Feedback: 

Tne  impact  of  OESO  feedback  upon  process  performance  was  evaluated 
by  compaiing  process  performance  between  the  four  modules  of  the  battle 
simulation.  Significant  differences  were  found  between  all  modules,  with 
progressive  improvements  in  process  performance  following  each  feedback 
occurrence. 

It  was  also  found  that  battalion  commanders  valued  tne  feedback  highly, 
and  most  expressed  the  viev;  that  the  OESOs  contributed  significantly  to  im¬ 
proving  the  performance  of  the  command  groups.  Furthermore,  OESO’s  process 
assessment  and  feedback  enhanced  their  general  credibility  with  commanders, 
and  there  were  strong  indications  that  the  commanders  would  continue  use  of 
OESO  consultation  after  completion  of  the  exercises. 

Implications  of  the  results  for  training  command  groups  and  battle 
staffs  are  discussed  in  the  report. 


Conclusions : 

1.  The  quality  of  command  group  performance  of  the  organizational 
processes  included  in  this  research  is  strongly  correlated  with  unit  com¬ 
bat  effectiveness,  as  reflected  by  the  outcomes  of  battle  simulations. 

2.  Feedback  of  process  observations  by  OESOs  appears  to  exert  a  posi¬ 
tive  effect  upon  the  effectiveness  of  command  groups. 

3.  OESOs  who  are  qualified  in  the  combat  arms  can  be  trained  easily 
to  assess  and  constructively  report  feedback  of  their  observations  concern¬ 
ing  the  process  performance  of  command  groups  and  battle  staffs. 
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4.  It  is  feasible  to  train  conrnan d  groups  and  battle  staffs  to  im¬ 
prove  their  process  performance  through  the  use  of  OESOs  as  consultants 
and  trainers. 
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ORGANIZATIONAL  PROCESS  AND  COMBAT  READINESS:  FEASIBILITY  OF 
TRAINING  ORGANIZATIONAL  STAFF  OFFICERS  TO  ASSESS 
COMMAND  GROUP  PERFORMANCE 


INTRODUCTION 

This  report  presents  results  of  the  first  phase  of  a  project  concerned 
with  research  on  the  relationship  between  organizational  process  perfor¬ 
mance  and  combat  readiness  of  U.S.  Army  units.  The  research  conducted  in 
Phase  I  was  designed  to  contribute  to  increased  understanding  of  the  in¬ 
ternal  processes  that  lead  to  combat  effectiveness  of  Army  units  and  to 
provide  understanding  of  the  potential  role  of  Organizational  Effective¬ 
ness  Staff  Officers  (OESO)  in  contributing  to  combat  readiness. 

To  accomplish  these  purposes,  the  research  in  Phase  I  was  devoted  to 
analysis  of  the  relationship  between  process  performance  and  the  combat 
outcomes  of  battle  simulations  and  to  determination  of  the  feasibility  of 
training  Organizational  Effectiveness  Staff  Officers  to  observe  and  assess 
the  process  performance  of  TOE  unit  battle  staffs  while  the  staffs  are 
participating  in  battle  simulations.  The  results  of  Phase  I  provide  a 
foundation  for  work  to  be  accomplished  in  Phase  II. 


TECHNICAL  OBJECTIVES 

The  technical  objectives  of  the  overall  roject  are  to  (a)  verify  the 
relationship  between  combat  readiness  and  the  performance  of  certain  or¬ 
ganizational  processes,  and  (b)  determine  whether  training  of  Army  battle 
staffs  in  performance  of  the  processes  will  en.oa.oce  the  combat  outcomes  cf 
battle  simulations  in  which  they  participate. 

Objectives  for  Phase  I  were  as  follows: 

1.  Determine  the  relationship  between  process  performance  by  bat¬ 
talion  command  groups  during  participation  in  battle  simulations 
and  the  combat  outcomes  of  such  simulations. 

2.  Determine  the  feasibility  of  training  OESGs  to  observe  ar.d  assess 
the  process  performance  of  battle  staffs  while  the  staffs  partici¬ 
pate  in  battle  simulations. 

Accomplishment  of  the  Phase  I  objectives  will  provide  fundamental  in¬ 
formation  needed  to  accomplish  Phase  II,  which  is  concerned  with  develop¬ 
ment  of  a  delivery  system  for  training  command  groups  and  battle  staffs  in 
process  performance  and  with  evaluation  of  the  capability  of  such  training 
for  enhancing  combat  readiness. 


BACKGROUND 


The  organizational  processes  which  are  the  focus  of  the  research  re¬ 
ported  here  were  identified  in  a  series  of  studies  conducted  during  the 
period  1970-76  (Olmsteaa,  Christensen,  &  Lackey,  1973;  Olmstead  &  Christ¬ 
ensen,  1973;  Olmstead,  Christen  -cn,  Salter,  &  Lackey,  1975) .  The  studies 
were  based  upon  a  conceptual  framework  derived  from  General  Systems  Theory 
^Miller,  1955;  von  Bertalanffy,  1956)  and  several  adaptations  of  Systems 
Theory  to  the  theory  of  organizations  (Bennis,  1966;  Emery  &  Trist,  1965; 
Katz  &  Kahn,  1966;  Parsons,  1956,  I960;  and  Schein,  1972). 

The  conceptual  framework  centers  around  the  key  concept  of  Organiza¬ 
tional  Competence.  The  concept  was  derived  to  encompass,  within  one  term, 
the  internal  operational  processes  used  by  organizational  systems  to  achieve 
their  objectives  and  to  cope  with  continuously  changing  environments.  Ben¬ 
nis  '  concepts  of  Reality  destine  and  Adaptability  and  Parsons'  concept  of 
Integration  were  taken  as  basic  components  of  Organizational  Competence. 
Thus,  Organizational  Competence  was  defined  as  having  the  following 
components : 

1.  Reality  Testing.  Capacity  to  assess  the  reality  of  situations 
facing  the  organization — the  ability  of  the  organization  to 
search  out,  accurately  perceive,  and  correctly  interpret  the 
properties  and  characteristics  of  its  environments  (both  external 
and  internal) ,  particularly  properties  that  have  relevance  for 
the  objectives  and  survival  of  the  organization. 

2.  Adaptability .  The  capacity  of  the  organization  to  solve  problems 
arising  from  changing  environmental  demands  and  to  act  with  ef¬ 
fective  flexibility  in  response  to  these  changing  demands. 

3.  Integration .  The  maintenance  of  structure  and  internal  function 
ander  change  and  stress,  and  a  state  of  relations  among  sub-units 
that  insures  that  coordination  is  maintained  and  sub-units  do  not 
work  at  cross  purposes. 

To  operationalize  the  above  components  so  that  they  could  be  measured, 
the  following  seven  processes  were  derived  from  3 c he in 1 s  (1972)  Adaptive- 
Coping  Cycle; 

1.  Sensing.  The  process  by  which  an  organization  acquires  and  pro¬ 
cesses  information  about  its  internal  and  external  environments. 

2.  Communicating  Information.  The  process  of  transmitting  informa¬ 
tion  that  is  sensed  to  those  parts  of  the  organization  that  can 
act  upon  it. 

3.  Decision-making .  The  process  of  making  decisions  concerning  ac¬ 
tions  to  be  taken  as  the  result  of  sensed  information. 

4.  Stabilizing.  The  process  of  taking  actions  to  adjust  internal 
functioning  and  maintain  organizational  stability  and  integration 


2 


that  might  otherwise  be  disrupted  as  a  consequence  of  actions 
taken  to  cope  with  changes  in  the  organization's  environments. 


5.  Communicating  Imple  ..i/itation.  The  process  of  transmitting  de¬ 
cisions  and  decision-related  orders  and  instructions  to  those 
parts  of  the  organization  that  must  implement  them. 

6.  Coping  Actions.  The  process  of  executing  actions  intended  to 
cope  with  changes  in  the  organization's  environments. 

7.  Feedback .  The  process  of  evaluating  the  results  of  a  prior  ac¬ 
tion  through  further  sensing  of  the  external  and/or  internal 
environments . 


It  is  important  to  note  that  each  of  these  organizational  processes  was 


conceived  to  be  related  to  one  of  the 
tionships  are  as  follows: 

Competence  Component 

Reality  Testing 

Adaptability 

Integration 


components  of  Competence.  The  rela- 


Organizational  Process 
Sensing , 

Communicating  Information, 
Feedback 

Decision-making, 

Communicating  Implementation, 
Coping  Actions 

Stabilizing 


Thus,  each  component  of  Competence  comprises  one  or  more  organizational 
processes  that  can  be  measured  and  whose  quality  can  be  evaluated. 


The  conceptual  framework  was  first  tested  in  a  study  of  10  simulated 
U.S.  Army  Infantry  battalion  battle  staffs  (command  group  and  company  com¬ 
manders)  engaged  in  simulated  combat  operations  in  a  Command  Post  Exercise 
(CPX)  configuration  (Olmstead,  Christensen,  &  Lackey,  1973).  It  was  found 
that  Organizational  Competence  was  strongly  correlated  with  independent 
criteria  of  Organizational  Effectiveness  as  measured  by  battalion  perfor¬ 
mance  on  a  series  of  mission-related  operational  problems.  Furthermore, 
the  Competence  components  were  differentially  related  to  effectiveness, 
with  Reality  Testing  contributing  the  largest  proportion  of  variance. 
Adaptability  contributing  a  smaller  but  significant  proportion,  and  Inte¬ 
gration  a  modest  proportion. 


Organizational  processes  are  the  fundamental  elements  of  Competence. 
The  seven  processes  were  found  to  be  differentially  related  to  organiza¬ 
tional  effectiveness;  however,  all  contributed  to  some  extent.  Most  cor¬ 
relations  were  quite  high.  It  should  be  noted  that  frequency  of  process 
occurrence  was  not  correlated  with  effectiveness.  Thus,  Organizational 
Competence  is  the  quality  of  process  performance.  The  finding  of  a  very 
strong  relationship  between  Competence  and  effectiveness,  together  with 
that  of  no  relationship  between  frequency  and  effectiveness,  permitted 
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the  conclusion  that  the  principal  contributor  to  organizational  effective¬ 
ness  is  how  well  organizational  processes  are  performed,  and  not  how  often 
they  occur. 

The  research  on  Army  battalions  was  also  designed  to  evaluate  the  ef¬ 
fects  upon  competence  and  effectiveness  of  strong  pressure  from  operational 
environments  and  of  radical  changes  within  operational  environments.  It 
was  found  that  the  ability  of  an  organization  to  respond  flexibly  to  changes 
in  its  operational  environments  is  dependent  upon  its  Competence,  i.e.,  the 
quality  of  its  process  performance.  Similarly,  the  ability  of  an  organi¬ 
zation  to  maintain  effectiveness  under  pressure  from  its  environments  is 
related  to  its  Competence. 

The  results  of  the  above  study  demonstrate  the  critical  importance  of 
process  performance  as  a  determinant  of  organizational  effectiveness.  Com¬ 
petence  is  the  adequacy  with  which  an  organization  performs  certain  criti¬ 
cal  processes.  When  the  processes  are  performed  adequately,  they  assist 
an  organization  to  be  effective.  When  handled  poorly,  they  may  negate  many 
positive  effects  contributed  by  efficiency  in  other  areas. 

In  two  additional  studies,  Organizational  Competence  was  evaluated  ir. 
organizations  that  were  greatly  different  from  military  combat  units.  Sur¬ 
vey  techniques  were  used  to  evaluate  Competence  in  31  social  sirvice  and 
rehabilitation  agencies  nationwide  (Olmstead  &  Christensen,  1973)  and  in 
an  additional  17  social  service  agencies  in  nine  States  (Olmstead,  Christ¬ 
ensen,  Salter,  &  Lackey,  1975).  In  both  studies,  vary  strong  relationships 
were  found  between  agency  effectiveness  and  Organizational  Competence,  each 
cf  the  components  of  Competence,  and  each  organizational  process.  Effec¬ 
tiveness  was  measured  in  terms  of  agency  productivity  and  judged  quality 
of  agency  performance . 

The  results  of  the  above  studies  confirm  the  validity  of  the  conceptual 
framework  as  a  viable  approach  for  analyzing  and  understanding  the  perfor¬ 
mance  of  complex  organizations.  The  principal  contribution  is  concrete 
demonstrations  of  the  importance  of  the  processes  subsumed  under  Organiza¬ 
tional  Competence  as  determinants  of  the  effectiveness  of  organizations, 
of  the  relative  contributions  of  the  various  processes,  of  the  systematic 
relationships  that  exist  among  the  processes,  and  of  the  ways  in  which 
change  and  pressure  influence  their  performance.  It  is  apparent  that  Com¬ 
petence  plays  a  major  role  in  the  performance  of  organizations  and,  accord¬ 
ingly,  warrants  major  attention  in  efforts  to  improve  ef fcctiveness . 

It  is  also  apparent  that  the  concepts  and  findings  discussed  above 
have  considerable  potential  utility  for  the  improvement  of  comrac  readi¬ 
ness  in  operational  military  units.  For  example,  current  Army  Training  and 
Evaluation  Program  (ARTEP)  philosophy  calls  for  a  unit  to  be  assessed  on 
outcome  variables,  e.g.,  mission  accomplishment,  and  there  is  some  provision 
for  assessment  of  command  group  proficiency  in  performance  of  certain  manor 
tasks  deemed  relevant  for  accomplishment  of  combat  missions.  However, 

ARTEP  assessment  practices  do  not  include  diagnostic  procedures  that  will 
enable  commanders  to  better  understand  and  assess  the  performance  by  battle 
staffs  of  the  organizational  processes  that  affect  combat  outcomes.  If 
such  procedures  could  be  developed,  they  would  constitute  an  important 
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addition  to  the  training  capabilities  of  unit  commanders.  The  processes 
that  make  up  Organizational  Competence  provide  a  meaningful  and  feasible 
framework  to  develop  such  procedures. 


Organizational  Effectiveness  Staff  Officers  are  practitioners  of  the 
Army's  current  Organizational  Effectiveness  (OE)  technology.  As  such, 
these  officers  are  trained  to  observe  and  assist  in  the  diagnosis  of  group 
and  organizational  attributes.  Furthermore,  they  are  trained  to  help  com¬ 
manders  plan  and  implement  strategies  for  change  within  their  units.  Ac¬ 
cordingly,  OESOs  possess  the  basic  orientation,  training,  and  skills  re¬ 
quired  to  observe  and  assess  the  performance  of  the  Competence  processes 
and  to  assist  commanders  in  training  battle  staffs  or  command  groups  to 
improve  process  performance. 

The  project,  the  first  phase  of  which  is  reported  here,  is  concerned 
with  verifying  the  relationship  between  combat  readiness  and  performance 
of  the  identified  organizational  processes  and  with  determining  whether 
training  of  Army  command  groups  in  performance  of  the  processes  will  en- 
hanct  the  comb'*-  outcomes  of  battle  simulations  in  which  they  participate. 

As  a  part  of  that  project,  Fhase  1  was  devoted  to  two  main  objectives: 

(a)  verify  the  relationship  between  combat  o: tcomes  of  battle  simulations 
and  the  process  performance  of  battalion  command  groups  in  such  simulations, 
and  (b)  determine  the  feasibility  of  training  CESOs  to  observe ,  assess, 
and  report  assessments  of  t.ne  process  performance  of  command  groups  while 
the  groups  participate  in  battle  simulations. 


All  data  were  collected  m  as  r.atir:.  w;tr.  Cardinal  Point  II,  a  large 
training  exercise  conduct  by  t.ne  oth  Infantry  1 1 vision  m  Europe  during 
duly  and  August  19'e. 

For  each  battalion,  Cardinal  Feint  II  was  an  11-day  exercise  consist¬ 
ing  of  a  combination  of  Field  Trainin':  Exercise  (FIX',  battle  simulation 
iFEjASUS),  and  live  firing.  The  data  : resented  ir.  tnis  report  were  collected 
curing  participation  of  battalion  command  group  s  m  the  tattle  simulation 
phase  cf  Cardinal  Point  II. 


PEGASUS 


PEGASUS  a  two-sided  manual  battle  simulation  that  makes  possible  a 
training  s  n  in  which  a  battalion  command  greu:  interacts  with  con¬ 
trollers  'oerior-unit  levels  anu  with  controllers"  playing 

friendly  •  commanders.  The  exerc.se  is  ; launel  and  directed  by 

an  Exercit  Activities  of  centre  1  lers  ar<-  supervised  by  a  Chief 

Controller.  controllers  are  sr.erv:  e:  by  a  .  ref  Table  Controller. 


Using  a  control  map  to  depict  disposition  am  m  vemc.t  of  forces,  friendly 
table  controllers  maneuver  their  units  arccr  ur.u  t  -  instructions  from  the 
battalion  command  group  so  as  to  engage  ir.  cord  at  with  enemy  units  maneuvered 
by  Opposing  Force  (OPFOR)  controllers.  f  r.  :  a  recent  cut  comes  are  determined 
by  manual  computation  using  combat  results  tables  \ rovided  specifically  for 
use  with  PEGASUS.  Play  is  activate:  by  a-  era*  i  :.s  order  issued  by 


Brigade.  In  the  order,  a  mission  is  assigned  and  typical  intelligence  and 
other  information  is  provided.  Initial  friendly  and  OPFOR  unit  strengths 
may  be  varied  according  to  the  training  plan  and,  therefore,  differing 
force  ratios  may  be  played.  Thus,  PEGASUS  is  a  flexible,  two-sided,  free- 
play  battle  simulation  which  provides  dynamic  and  realistic  opportunities 
for  battalion  command  groups  to  experience  and  practice  required  command 
and  control  activities. 

In  Cardinal  Point  II,  PEGASUS  was  the  vehicle  used  in  the  battle  simu¬ 
lation  phase,  in  which  focus  was  upon  the  battalion  commander  and  his  staff 
while  controlling  and  coordinating  operations.  Company  commanders  served 
as  "board  players,"  i.e.,  controllers,  for  their  respective  command  groups. 

During  the  simulation,  each  battalion  constituted  a  task  force  operat¬ 
ing  in  association  with  another  player  battalion  task  force  under  the  com¬ 
mand  and  control  of  a  brigade  headquarters.  The  brigade  commander  served 
as  Chief  Controller  and  Chief  Evaluator,  as  well  as  PEGASUS  brigade  commander. 

During  one  iteration,  two  battalion  task  forces  conducted  simulated 
combat  operations  in  adjacent  lanes  of  the  8th  Division  training  area. 

Task  force  command  posts  were  located  on  the  actual  terrain  in  the  respec¬ 
tive  lanes,  while  subordinate  unit  activities,  conducted  by  the  company 
commanders,  took  place  on  game  boards  in  a  central  location  at  the  training 
area  headquarters.  Communication  was  by  the  conventional  radio  nets. 

The  task  force  CPs  displaced  as  dictated  in  the  operational  plans  or 
by  the  tactical  situations.  Periodically,  company  commanders  traveled  for¬ 
ward  to  the  task  force  CPs  to  receive  orders,  conduct  reconnaissance,  or 
take  part  in  critiques  conducted  by  evaluators. 

During  the  2-month  duration  of  Cardinal  Point  II,  seven  iterations 
of  the  PEGASUS  exercise  were  conducted.  In  five  iterations,  two  battalions 
participated  simultaneously.  In  two  iterations,  only  one  battalion  par¬ 
ticipated  at  a  time.  Thus,  a  total  of  12  battalions  participated. 

Each  iteration  required  4  days  to  complete.  Participation  of  the  com¬ 
mand  groups  was  continuous,  day  and  night,  during  each  4-day  period.  With¬ 
in  that  period,  four  modules  were  completed,  with  each  module  consisting 
of  one  or  more  types  of  combat  operations.  Within  each  module,  the  sequence 
of  activities  was  as  follows: 

1.  Warning  order  from  Brigade 

2.  Fragmentary  order  from  Brigade 

3.  Task  force  orders,  terrain  reconnaissance 

4.  Battle  simulation  {approximately  6  hours) 

5.  Critique 

6.  Warning  order  from  Brigade  for  next  module. 

With  minor  deviations,  the  types  of  operations  covered  by  the  respec¬ 
tive  modules  were  the  same  for  all  units.  Similarly,  the  sequence  in  which 
the  operations  were  executed  was  the  same.  On  the  other  hand,  specific 
events  within  a  module  varied  considerably  between  units  because  PEGASUS 
is  a  free-play  simulation  and  OPFOR  players  were  free  to  insert  special 
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problems,  e.g.,  chemical  and  nuclear  play  or  communications  jamming,  as 
deemed  useful  for  training  purposes. 


Role  of  Organizational  Effectiveness  Staff  Officers 

--  Two  OESOs  assigned  to  the  8th  Infantry  Division  participated  in  the 
battle  simulation  phase  of  Cardinal  Point  II.  Throughout  each  iteration 
of  the  battle  simulation,  one  OESO  was  stationed  at  each  battalion  command 
pest.  The  OESO  systematically  observed  the  activities  of  command  group 
members  as  they  proceeded  to  plan  and  supervise  execution  of  each  operation. 
OESO  observations  were  addressed  to  identification  and  assessment  of  the 
quality  of  performance  of  the  various  organizational  processes  by  the  com¬ 
mand  group.  The  focus  of  the  observation  was  the  questions,  "What  process 
is  occurring?  How  well  is  it  being  performed?  How  could  it  have  been  per¬ 
formed  better?" 

An  OESO  remained  with  a  command  group  continuously  throughout  the 
four-module  cycle  of  the  battalion's  participation  in  the  battle  simula¬ 
tion.  Upon  completion  of  each  module,  the  OESO  rated  performance  of  the 
command  group  on  each  Competence  process  according  to  rating  scales  devel¬ 
oped  for  that  purpose  (discussed  below) .  Then  the  OESO  met  with  the  bat¬ 
talion  commander  and  reported  the  results  of  his  observations.  Implications 
of  the  observations  for  functioning  of  the  command  group  were  discussed. 

This  procedure  of  prompt  "feedback"  to  the  commander  enabled  him  to  obtain 
immediate  assessment  of  the  quality  of  process  performance  in  the  command 
group  and,  if  deemed  advisable  by  him,  afforded  the  opportunity  to  make 
on-the-spot  adjustments  in  procedures,  policies,  and  behavior  of  members 
of  the  command  group.  In  many  instances,  at  the  commanders'  discretion, 
OESCs  also  reported  results  of  observations  to  command  group  members  and 
assisted  in  analyses  of  ways  process  performance  could  be  improved. 

Thus,  an  OESO  served  as  "eyes  and  ears"  of  a  commander  with  respect 
to  the  quality  of  performance  of  organizational  processes  within  the  com¬ 
mand  group  and  provided  a  mechanism  through  which  on-the-spot  feedback 
could  be  made  available  to  the  commander.  In  addition,  OESO  ratings  of 
process  performance  were  one  major  source  of  data  for  this  study. 


Training  of  Organizational  Effectiveness  Staff  Officers 

Three  days  before  the  battle  simulation  phase  of  Cardinal  Point  II, 
researchers  met  with  the  two  8th  Division  OESOs  for  the  purpose  of  train¬ 
ing  the  OESOs  to  observe  and  assess  process  performance  of  battalion  com¬ 
mand  groups.  Two  days  were  devoted  to  the  training. 

Prior  to  beginning  of  training,  the  OESOs  had  studi 'd  "Components  of 
Organizational  Competence:  Test  of  a  Conceptual  Framework"  (Olmstead, 
Christensen,  &  Lackey,  1973) ,  which  descriDes  the  theoretical  background 
and  conceptual  framework  for  the  Competence  processes  and  presents  results 
of  the  earlier  study  of  Army  battalions.  The  training  consisted  of  review 
and  elaboration  of  the  fundamental  concepts;  analysis  of  the  PEGASUS  con¬ 
figuration  for  Cardinal  Point  II  and  its  implications  for  operational 
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definition  of  the  processes;  revised  definitions  of  the  processes  for  ap¬ 
plication  to  single-level  organizations,  i.e.,  to  command  groups  alone; 
procedures  for  observing  and  identifying  the  processes  within  command 
groups;  procedures  for  assessing  the  quality  of  process  performance;  and 
recommendations  for  providing  feedback  of  observations.  In  addition,  data 
collection  forms  and  procedures  for  recording  process  ratings  were  reviewed, 
general  questions  to  be  addressed  in  assessment  of  process  performance  are 
shown  in  Appendix  A.  Definitions  of  the  processes  and  criteria  for  identi¬ 
fying  and  assessing  them  are  shown  in  Appendix  B. 

It  is  important  to  note  that  both  OESOs  were  combat  arms  officers, 
with  experience  in  battalion  staff  activities.  These  qualifications  and 
experience,  coupled  with  their  OE  training,  made  translation  and  appli¬ 
cation  of  the  conceptual  framework  decidedly  more  effective. 

After  OESOs  participated  in  the  first  iteration  (two  battalions) , 
the  researchers  met  with  the  OESOs  to  review  and  clarify  any  problems 
encountered. 


Data  Collection 

Data  were  collected  on  12  battalion  comman  .1  groups.  Included  were 
seven  Mechanized  Infantry  and  five  Armor  battalions.  Following  completion 
of  each  module,  OESOs  rated  process  performance  and  OPFOR  controllers  rated 
combat  effectiveness  of  the  battalions,  as  described  below.  The  ratings 
were  collected  immediately  upon  completion.  Thus,  for  each  battalion  there 
were  available  four  ratings  (one  for  each  module)  on  process  performance 
and  four  on  combat  effectiveness. 

OPFOR  controllers  varied  their  inputs  depending  upon  the  tactical 
situation.  In  addition,  different  types  of  operations  were  judged  to  vary 
in  terms  of  difficulty.  To  obtain  some  indication  of  relative  difficulty 
of  the  four  modules,  the  Chief  Controller  and  the  Chief  OPFOR  Controller 
rated  difficulty  of  each  module  for  each  unit  on  a  5-point  scale.  Mean 
ratings  across  units  were  computed  to  obtain  an  index  of  difficulty  for 
each  module. 

Process  Performance  Ratings.  After  completion  of  each  module,  the 
OESOs  assigned  to  the  respective  battalions  completed  the  form  shown  in 
Appendix  C.  The  form  contains  seven  items,  one  for  each  organizational 
process,  upon  which  an  OESO  rated  the  performance  of  a  command  group. 

Raters  used  a  4-point  scale,  chosen  because  it  was  found  in  the  original 
study  of  Army  battalions  (Olmstead,  Christensen,  &  Lackey,  1273)  that 
assessers  of  process  performance  encountered  difficulty  in  discriminating 
quality  of  performance  when  scales  of  more  than  4  points  were  used. 

Data  forms  were  collected  immediately  after  completion  by  OESOs. 

Since  one  OESO  was  assigned  to  each  battalion  command  group,  one  set  of 
ratings  was  produced  for  each  command  group  for  each  module. 

Combat  Effectiveness.  Upon  completion  of  each  module,  OPFOR  control¬ 
lers  completed  the  Controller  Rating  Form  shown  in  Appendix  D.  It  will  be 
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recalled  that,  in  most  instances,  two  battalions  participated  in  tandem. 
Thus,  two  PEGASUS  gaming  simulations  were  conducted  simultaneously,  one 
for  each  of  two  battalions,  with  the  battalions  participating  in  the  roles 
of  adjacent  task  forces  under  the  direction  of  a  single  brigade  commander. 
For  each  simultaneous  simulation,  a  team  of  three  OPFOR  board  controllers 
conducted  play  of  enemy  operations.  A  Chief  OPFOR  Controller  supervised 
the  activities  of  the  two  teams.  All  members  of  each  team  of  OPFOR  con¬ 
trollers  completed  the  Controller  Rating  Form  for  respective  battalions 
for  which  they  served  as  controllers.  The  Chief  OPFOR  Controller  rated 
both  battalions.  Thus,  for  each  battalion,  ratings  of  four  controllers 
were  collected. 

The  Controller  Rating  Form  consisted  of  five  items  addressed  to  a 
number  of  aspects  of  combat  outcomes  as  reflected  in  the  battle  simulation. 
For  all  items,  respondents  used  5-point  rating  scales  with  3  anchor  points 
having  descriptors  specific  to  the  content  of  the  items. 

Interviews .  The  two  GESOs  were  extensively  interviewed  after  comple¬ 
tion  of  the  entire  exercise  to  identify  problems  encountered,  lessons 
learned,  and  experiences  that  might  prove  useful  in  development  of  train¬ 
ing.  In  addition,  several  battalion  commanders  were  interviewed  to  obtain 
their  judgments  of  the  impact  of  GESO  feedback. 


Data  Reduction 

Data  consisted  of  OESO  ratings  of  process  performance,  OPFOR  Controller 
ratings  of  combat  effectiveness,  and  interviews  with  OESO  and  battalion 
commanders. 

Process  Performance.  For  each  battalion,  the  OESC  ratings  of  perfor¬ 
mance  of  a  process  constituted  a  Module  Process  Score,  with  a  possible 
score  range  of  1  to  4.  Thus,  for  an  exercise  (four  modules),  a  unit  could 
receive,  for  each  organizational  process,  a  minimum  score  of  4  and  a  maxi¬ 
mum  score  of  16.  Scores  for  Organizational  Competence  were  computed  as 
the  sum  of  the  seven  process  scores.  For  a  module,  the  minimum  possiole 
Competence  Score  was  7  ar.d  maximum  was  28.  For  an  exercise,  a  battalion's 
Competence  Score  could  range  from  28  to  112. 

Combat  Effectiveness.  The  problem  was  to  develop  a  procedure  which 
would  make  it  possible  to  order  participating  battalions  in  terms  of  over¬ 
all  effectiveness.  An  adaptation  of  a  procedure  previously  used  for  as¬ 
sessing  battle  simulation  outcomes  of  brigades  (Olmsteaa,  Baranick,  S, 

Elder,  1978),  based  on  earlier  work  by  Tiede  and  Leake  (1971),  was  used  to 
develop  the  index  of  combat  effectiveness. 

Following  the  earlier  work  by  Tiede  and  Leake,  two  dimensions  were 
identified  that  define  the  mission  space  of  a  unit: 

1.  Area:  the  area  or  geographical  objectives  controlled  m  accomplish¬ 
ing  the  mission  or  during  the  engagement. 

2.  Resources :  the  quantity  of  resources  (personnel,  weapons,  equip¬ 
ment)  expended,  or  remaining,  at  the  end  of  the  engagement. 
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Appropriate  combinations  of  indicators  of  these  two  dimensions  make 
it  possible  to  order  participating  units  in  terms  cf  outcomes.  For  this 
project,  the  procedure  consisted  of  operationally  defining  anchor  points 
on  5-point  scales  for  Area  (Controller  Rating  Form  Item  2)  and  Resources 
(Controller  Rating  Form  Item  3) .  Using  the  two  Controller  Rating  Form 
items,  there  resulted  a  5  x  5  matrix,  each  cell  of  which  was  a  possible 
outcome  in  terms  of  combinations  of  the  two  dimensions.  The  matrix 
follows: 


_ AREA 

Control  of  area 
was  in  full 
compliance  with 
mission  requirements 
including  time  schedules 

5  4 


4 


3 


2 


1 


For  each  battalion,  module  mean  OPFOR  controller  ratings  were  computed 
for  Items  2  and  3  of  the  Controller  Rating  Form.  To  obtain  an  index  which 
represented  a  combined  Resources  and  Area  outcome,  module  mean  ratings  for 
Items  2  and  3  for  each  battalion  were  added.  The  sum  of  these  two  ratings 
was  designated  the  Combat  Effectiveness  Score.  The  result  was  a  distribu¬ 
tion  of  12  battalion  scores  for  each  module,  with  a  possible  range  of  2  to 
10  for  a  module.  In  addition  to  the  Combat  Effectiveness  Score  described 
above,  a  second  index  was  suggested  by  examination  of  the  matrix  of  inter¬ 
correlations  of  the  five  separate  OPFOR  controllers'  ratings  of  battalion 
combat  outcomes.  All  five  were  highly  intercorrelated ,  indicating  the  high 
probability  of  a  single  underlying  dimension.  The  average  of  the  five 
separate  rating.,  thus  was  selected  as  the  second  index  of  battalion  conbat 
performance. 


Remaining  strength 
such  that  operation 
can  be  continued 
without  interruption 


Resources  remaining 
were  not  more  than 
75  nor  less  than 
60  percent 


Resources  remaining 
make  unit  ineffective, 
should  be  replaced. 


Mission 
requirements 
and  partly  met 
with  respect  to 
control  of  area 


Mission 
requirements 
not  met  in 
any  way 
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RESULTS 


Quantitative  data  were  available  from  OESO  ratings  of  command  group 
process  performance  and  OPFOR  Controller  ratings  of  combat  outcomes  of 
PEGASUS  battle  simulations.  For  each  battalion,  total  scores  for  the  ex¬ 
ercise  and  scores  for  each  of  the  four  modules  composing  the  exercise  were 
obtained.  Table  1  shows  summary  data  for  the  seven  organizational  processes. 
Organizational  Competence  (sum  of  the  process  scores) ,  and  Combat  Effective¬ 
ness,  as  measured  by  performance  outcome  Items  2  and  3. 


Table  1 

Summary  Data  for  Process  Performance 
and  Combat  Effectiveness 


Variable 

„  .  ,  1.2 

Module 

Exercise 
(Sum  of 

Module  Scores)  1 

_  _  _ _ _ 1 

1  (2.45) 

2  (3.54) 

3  (4.25) 

4  (3.17) 

Mean 

|  SD 

Mean  j 

Mean 

|  SD 

Mean 

SD 

Mean 

SD 

Sensing 

2.25 

.75 

3.08 

.52 

3.25 

.62 

3.67 

.49 

12.25 

1.48 

Communicating 

1.83 

.96 

2.75 

.62 

3.17 

.58 

3.58 

.69 

11.33 

2.06 

Information 

Decision  Making 

3.58 

.51 

3.75 

.45 

3.67 

.49 

4.00 

.00 

15.30 

1.34 

Stabilizing 

3.08 

1.31 

3.25 

.97 

3.33 

.89 

3.42 

.90 

13.CS 

3.70 

Communicating 

3,42 

'.78 

3.58 

.52 

3.41 

.69 

3.67 

.49 

14.08 

1.92 

Implementation 

' 

Coping  Actions 

3.33 

.79 

3.50 

.52 

3.58 

.52 

3.58 

.52 

14.00 

2.13 

Feedback 

2.00 

.74 

2.67 

.65 

3.17 

.84 

3.42 

.52 

11.25 

2.13 

Organizational 

18.91 

2.96 

22.25 

3.54 

23.50 

3.52 

25.25 

2.83 

89.91 

11.60 

Competence 

Combat 

4.72 

1.00 

5.62 

1.28 

4.79 

1.65 

6.13 

1.04 

21.25 

3.10 

Effectiveness 

1/  Numbers  In  parentheses  following  module  designations  are  difficulty 
ratings,  maximum  difficulty  •  5.00. 


2/  Possible  score  ranges:  Module 

Processes  1 -4 

Competence  7-28 

Combat  Effectiveness  2-10 


Exercise 

4-16 

28-112 

8-40 


Process  Performance  and  Combat  Outcomes 


Examination  of  the  raw  competence  scores  suggested  the  strong  likeli¬ 
hood  of  a  rater  mean  bias  effect.  That  is,  one  of  the  two  raters  had  a 
mean  that  was  substantially  higher  than  the  other  rater's  mean.  To  control 
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for  this  bias,  the  separate  process  performance  ratings  were  al)  transformed 
to  standard  scores,  and  the  remainder  of  the  analysis  was  conducted  on  the 
standard  score  forms. 

Pearson  product  moment  correlations  were  computed  between  the  compo¬ 
nents  of  Organizational  Competence,  on  the  one  hand,  and  the  components  of 
combat  effectiveness,  on  the  other  hand.  These  correlations,  together 
with  those  for  Total  Competence  and  the  two  Combat  Effectiveness  scores, 
are  shown  in  Table  2.  Of  particular  note  are  the  correlations  of  .67  and 
.63  between  the  two  Combat  Effectiveness  scores  of  total  Organizational  Com¬ 
petence.  These  correlations  were  significant  at  the  .01  and  .05  levels, 
respectively.  Thus,  a  significant  and  strong  positive  relationship  was 
found  between  the  quality  of  battalion  command  group  organizational  process 
performance  and  combat  outcomes  as  measured  in  a  battle  simulation. 

Examination  of  the  relationships  between  combat  effectiveness  and  indi¬ 
vidual  process  performance  scores,  and  between  Total  Competence  and  the 
individual  elements  of  combat  effectiveness,  suggests  further  conclusions. 
Combat  effectiveness  correlated  most  strongly  with  the  individual  processes 
concerned  with  Reality  Testing:  Sensing,  Communicating  Information,  and 
Feedback.  Of  these  three,  relationships  were  strongest  with  Sensing  and 
Feedback,  the  two  processes  assessing  the  effectiveness  with  which  the  com¬ 
mand  group  looked  for  and  obtained  information  about  its  combat  environment. 
In  systems  terms,  the  quality  of  processes  performed  within  the  organization, 
such  as  decision-making,  were  less  strongly  correlated  with  overall  outcomes 
than  the  quality  of  processes  concerned  with  seeing  outside  itself. 

The  distribution  of  standardized  Organizational  Competence  scores  was 
split  at  the  median,  and  the  six  highest  and  lowest  battalions  were  grouped. 
Table  3  shows  mean  combat  outcome  ratings  for  the  separate  components  and 
for  both  Combat  Effectiveness  scores.  All  comparisons  were  significant 
at  the  .05  level  (one-tailed  test)  except  the  rating  of  resources  remain¬ 
ing,  which  narrowly  missed  significance.  The  largest  differences  between 
high  and  low  Organizational  Competence  battalions  were  on  the  variables 
of  mission  accomplishment  and  force  exchange  ratio.  The  latter  is  particu¬ 
larly  noteworthy  in  view  of  current  U.S.  Army  doctrine  for  fighting  a  cen¬ 
tral  battle  against  near  overwhelming  odds.  The  doctrine  calls  for  trad¬ 
ing  time  and  terrain,  within  well-defined  limits,  for  the  opportunity  to 
inflict  disproportionately  high  losses  on  the  enemy.  This  clearly  will 
work  only  if  friendly  forces  have  the  skill  to  achieve  a  highly  favorable 
loss  exchange  ratio.  Battalions  with  high  Competence  scores  in  the  present 
research  had  better  loss  echange  ratios.  If  further  research  confirms  the 
present  finding,  an  important  approach  to  helping  the  current  doctrine 
work  well  has  been  found. 


Training  of  Organizational  Effectiveness  Ftaff  Officers 

The  fact  that  the  two  OESOs  who  participated  in  the  project  were  able 
to  identify  the  various  organizational  processes  and  assess  their  quality 
with  little  difficulty  during  the  intensive  activity  characteristic  of 
battalion  TOCs  during  combat  operations  demonstrates  the  feasibility  of 
training  OESOs  to  perform  these  functions.  The  OESOs  were  t  uned  on  an 
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Table  2 


Correlations  Among  Organizational  Process 
Scores  and  Combat  Outcomes 
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.09 

.02 

Batt  Eff 
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.58 

.32 

.55 

.34 

.30 

.39 
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2-3 
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.15 

.03 

.14 

.17 

.  10 

.01 
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*The  top  number  v.'ithin  a  cell  is  the  correlation  coefficient.  The 
bottom  number  is  the  computed  significance  of  the  correlation. 
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Table  3 


Comparison  of  Battalion  Effectiveness  by  More  and  Less 
Process  Effective  Battalions^ 


Effectiveness 

Dimension 

!  V.^rc  Effective  | 

Process 

: 

I.ees  Effective 

Pro-ess 

1 

t 

i 

F2 

Moan 

SD 

Mean 

SD 

' 

Mission 

Accomplishment 

3.43 

.46 

2.80 

.24 

i 

2.96 

£.01 

Geographical 

Area 

' 

3.39 

|  .50 

l 

2.83 

1 

.38 

2.18 

£.03 

Resources  | 

Remaining 

2.3S 

1 

.29 

2.03 

! 

.39  1 

i 

1.76 

1 

£.054 

Force  Exchange 

Ratio 

2.91 

' 

.19 

2.39 

.35 

£.005 

Overall 

Effectiveness 

3.34 

.37 

2.96 

.36 

£.05 

Battalion  Staff 
Effectiveness  | 

4.13  | 

.49 

3.73 

.20 

1.86 

<  .  046 

Battalion  \ 

Effectiveness 

1-5 

3.09 

2.60 

•21  i 

: 

3.21 

£ .  C  C  4 

Battalion 

Effectiveness 

2-3 

2 . 88 

.33 

2.43 

'.  31 

< 

2.67 

£.02 

Sample  size  is  12  battalions.  Scores  shown  are  exercise  (four  modules) 

means . 

2 

One-tailed  test. 
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intensive  face-to-face  basis  by  the  contractor's  project  director,  who  had 
derived  and  tested  the  original  concepts  and,  accordingly,  was  most  inti¬ 
mately  familiar  with  the  conceptual  framework  and  the  action  implications 
of  the  concepts.  However,  the  ease  with  which  the  OESOs  assimilated  the 
concepts  and  recommended  procedures  and  applied  them  within  the  context  of 
an  operational  TOC  leaves  little  doubt  that  properly  qualified  OESOs  can 
be  trained  to  assess  process  per f oru.^nce  end  g : ve  feedback  on  the  results 
of  such  assessments  in  a  meaningful  manner. 

Experience  in  conducting  the  training  and  interviews  with  OESOs  and 
battalion  commanders  following  the  exercises  suggest  a  number  of  points 
for  consideration  in  selecting  and  training  OESOs.  By  far  the  most  criti¬ 
cal  consideration  involves  the  qualifications  and  experience  required  by 
OESOs.  Both  the  OESOs  and  the  battalion  commanders  who  were  interviewed 
were  unanimous  and  emphatic  in  their  views  that  an  OESO  who  attempts  to 
assess  and  feedback  process  performance  related  to  combat  operations  should 
be  combat  arms  qualified  and  familiar  with  the  roles  and  functions  of  com¬ 
bat  commanders  and  staffs.  Battalion  commanders  felt  such  qualifications 
are  necessary  for  the  credibility  of  OESOs.  In  short,  commanders  would 
not  be  receptive  to  feedback  from  OESOs  who  do  not  possess  first-hand 
knowledge  of  combat  command  croup  functions.  The  two  OESOs  fully  agree 
with  this  view  and,  in  addition,  maintain  that  although  individuals  who 
lack  the  above  qualifications  might  be  able  to  identify  processes,  they 
would  not  be  able  to  accurately  assess  whether  the  processes  were  performed 
well  and  to  identify  sources  of  deficiency.  Similarly,  it  appears  that 
CESOs  with  background  and  experience  relevant  to  the  units  under  scrutiny 
will  be  most  likely  to  be  successful  in  other  types  of  organizations. 

With  respect  to  trainir.c  of  OESOs,  the  following  important  considera¬ 
tions  were  identified: 

1.  Although  OESOs  reported  little  difficulty  in  understanding  the 
general  concepts,  careful  instruction  is  required  in  applica¬ 
tion  of  the  concepts  within  particular  contexts,  e.g.,  in  battle 
simulations . 

2.  Either  identification  criteria  specific  to  particular  contexts 
must  be  provided  or  instruction  must  be  provided  in  general  pro¬ 
cedures  for  specifying  and  defining  criteria. 

3.  Since  the  efficacy  of  a  process  is  situation-determined,  it  is 
not  possible  to  provide  universally  applicable  specific  criteria 
for  assessing  quality  of  process  performance.  However,  instruc¬ 
tion  in  the  use  of  general  criteria  concerning  process  quality 
must  be  provided. 

4.  OESOs  reported  that  they  did  not  feel  genuinely  comfortable  in 
making  process  observations  until  the  third  iteration  of  PEGASUS. 
This  suggests  tnat  training  should  be  heavily  experiential  in 
order  to  provide  students  as  much  experience  in  active  observa¬ 
tion  as  possible  prior  to  the  first  "for  real"  observations. 

5.  OE  training  provides  a  solid  foundation  in  techniques  of  feed¬ 
back;  however,  instruction  should  include  some  guidance  in  the 


specific  applications  of  such  techniques  to  feedback  of  process 
observations . 


Impact  of  Process  Feedback 


The  OESOs  reported  to  and  discussed  their  process  observations  with 
battalion  commanders  following  completion  of  each  module.  An  important 
question  is  concerned  with  the  impact  of  that  "feedback"  upon  the  process 
performance  of  the  command  groups. 

The  impact  of  feedback  was  evaluated  by  comparing  Organizational  Com¬ 
petence  scores  for  the  four  modules  liable  1) .  Table  4  summarizes  the  re¬ 
sults  of  a  simple  one-way  analysis  of  variance  used  to  test  the  effects  of 
modules . 


Table  4 

Analysis  of  Variance  for  Effects  of  Modules 


upon 

Process 

Performance 

Source 

ss 

df 

MS 

F 

V 

Total 

717.98 

47 

Modules 

257.56 

3 

85.85 

8.20 

<.01 

Error 

460.42 

44 

10.46 

Module  effects  were  significant.  Table  5  shows  t-statistics  for  dif¬ 
ferences  between  module  means  for  Organizational  Competence.  All  differ¬ 
ences  were  significant. 

Table  1  shows  that  mean  process  performance  (Organizational  Competence) 
increased  throughout  the  exercise,  and  Table  5  shows  that  differences  among 
all  modules  were  significant,  indicating  that  OESC  feedback  probably  exerted 
positive  effects  upon  process  performance  of  command  groups.  It  is  recog¬ 
nized  that  simple  practice  effects  were  not  controlled.  However,  control 
of  practice  effects  will  be  permitted  by  the  design  of  Phase  II  of  this 
research,  and  this  issue  consequently  is  deferred  until  completion  of  that 
work. 


Given  the  possibility  that  process  feedback  did  affect  subsequent 
process  performance,  the  differences  between  Modules  1  and  2  and  1  and  4 
are  of  particular  interest.  Performance  in  Module  1  occurred  prior  to  any 
feedback  or  discussion  of  organizational  processes.  Accordingly,  scores 
for  the  first  module  constitute  baseline  data  against  which  scores  for  the 
succeeding  modules  can  be  compared,  and  differences  between  performance  in 
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Modules  1  and  2  provide  the  most  clear-cut  demonstration  of  the  impact  of 
feedback.  The  mean  improvement  of  3.34  points  for  Module  2  is  the  largest 
increase  between  any  of  the  succeeding  modules  and  suggests  that  the  ini¬ 
tial  feedback  exerted  the  greatest  impact  upon  process  performance.  How¬ 
ever,  continuing  increases  in  succeeding  modules  suggest  cumulative  effects 
result  from  repeated  occurrences  of  feedback. 


Table  5 

Paired  _t-Statistics  for  Module  Differences 
in  Organizational  Competence 


Module 

Module"'’ 

12  3  4 

1 

3.98  7.69  7.82 

2 

2.09  5.32 

3 

3.02 

4 

- 

'''Degrees  of  freedom  =  11;  £  <  .05  =  1.796, 
£  <  .01  =  2.718  for  one-tailed  tests. 


From  Module  1  to  Module  4,  process  performance  improved  an  average  of 
6.34  points.  Least  improvement  was  3  points  for  a  unit  which,  because  of 
a  high  initial  score,  had  only  a  small  margin  for  improvement.  Greatest 
improvement  was  13  points.  Process  performance  of  all  command  groups  im¬ 
proved  across  the  four  modules. 

Interviews  with  the  two  OESOs  revealed  that  although  some  battalion 
commanders  had  initial  reservations  about  the  potential  value  of  process 
feedback,  most  commanders  rapidly  perceived  its  utility  and  used  the  infor¬ 
mation  provided  by  the  OESOs  to  make  on-the-spot  adjustments  in  staff  pro¬ 
cedures,  role  relationships,  and  even  leadership  styles  during  the  course 
of  the  exercises.  OESOs  cited  numerous  instances  of  constructive  changes 
initiated  by  the  commanders  and  of  improved  coordination  and  teamwork,  with 
resulting  improvements  in  overall  command  group  performance.  In  addition, 
all  commanders  invited  the  OESOs  to  continue  to  work  with  their  units  alter 
completion  of  Cardinal  Point  II. 

At  a  general  critique  session  held  after  all  units  had  participated 
in  PEGASUS,  battalion  commanders  were  positive  about  the  value  of  OESO 
process  observations  and  feedback.  Commanders  felt  th3t  the  presence  of 
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an  OESO  in  the  TOC  "provided  another  set  of  eyes  for  examining  command 
group  functioning”  and  "provided  a  different  perspective."  A  representa¬ 
tive  of  OETC  interviewed  four  commanders  and  all  felt  that  the  OESO  con¬ 
tributed  significantly  to  improved  combat  readiness. 

In  view  of  these  findings,  it  is  concluded  that  OESO  feedback  of 
process  observations  had  a  significant,  positive  impact  upon  performance 
of  the  organizational  processes  and  that  these  observations  and  subsequent 
feedback  to  unit  commanders  contributed  substantially  to  improved  combat 
outcomes  of  the  battle  simulations. 


DISCUSSION 

The  results  of  this  research  led  to  the  conclusions  that  the  organi¬ 
zational  processes  identified  in  Project  FORGE  {Olmstead,  Christensen,  & 
Lackey,  1973)  are  indeed  related  to  combat  outcomes,  that  improvements  in 
process  performance  should  contribute  to  improved  combat  readiness,  and 
that  Organizational  Effectiveness  Staff  Officers  can  serve  an  important 
function  in  assisting  commanders  to  improve  the  Organizational  Competence 
(process  functioning)  of  their  units  through  process  analysis,  feedback, 
and  training. 


Process  Performance  and  Combat  Effectiveness 


One  weakness  of  the  1973  study  was  that  ad  hoc  groups  were  used  to 
form  the  battle  staffs  that  were  studied.  In  the  research  reported  here, 
participants  were  members  of  actual  command  groups  engaged  in  the  conduct 
of  combat  operations  under  field  conditions.  Since  these  findings  are 
remarkably  similar  to  those  of  the  earlier  study,  it  can  be  concluded  with 
confidence  that  the  processes  subsumed  under  the  rubric  of  Organizational 
Competence  are  important  contributors  to  unit  combat  performance,  as  such 
performance  is  reflected  in  the  outcomes  of  battle  simulations.  To  the 
extent  that  the  command  and  control  system  of  a  unit  influences  the  per¬ 
formance  of  a  unit,  organizational  processes  are  determinants  of  unit  per¬ 
formance.  The  results  do  not  suggest  that  organizational  processes  are 
the  sole  determinants  of  unit  effectiveness;  however,  it  would  appear  that, 
because  of  their  criticality  for  command  and  control ,  it  is  unlikely  that 
a  unit  can  be  combat  effective  if  the  processes  are  not  performed  at  least 
adequately. 

Observations  conducted  during  this  study  also  reinforce  the  concept 
that  Organizational  Competence  is  a  system  attribute;  that  is,  organiza¬ 
tional  processes  must  be  performed  by  all  members  of  a  command  group  or 
battle  staff.  Ideally,  they  take  the  form  of  coordinated  activities  that 
bring  information,  decisions,  and  actions  from  many  sources  into  exjunc¬ 
tion  through  a  complex  interplay  between  positions  and  between  organiza¬ 
tional  levels.  Through  such  interplay,  the  various  activities  of  the 
organizational  system  are  integrated  and  their  parts  result  in  the  unified 
action  required  of  an  effective  combat  unit. 

Organizational  Competence  is  concerned  mainly  with  the  quality  of  per¬ 
formance  of  the  command  and  control  system  within  a  military  unit.  The 
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development  of  Ccm:  •  t  on  ji-  vitnia  a  cri.i'  unit  can  be  expected  to  produce 
(a)  a  more  smoothly  !  urut  ;  battle  staff;  (b)  improved  capabilities 

fo*-  adjustino  to  changes  it;  tactical  environments  and  situations  with 
minimal  wasted  effort,  last  notion,  or  reduced  effectiveness;  and 
(c)  higher  levels  of  effectiveness  under  the  sustained  pressures  of  com¬ 
bat.  Accordingly,  it  would  a;  j ear  that  attention  to  process  performance 
should  be  an  essential  consideration  in  the  development  of  combat  readiness. 


The  PESO  and  Combat  Readiness 

The  main  values  of  tne  conceptual  framework  subsumed  under  Organiza¬ 
tional  Competence  are  that  it  'a)  offers  a  systematic  way  of  thinking  about 
some  otherwise  exceeding ly  slippery  pnenomena  and  (b)  provides  a  workable 
framework  for  the  assessment  and  diagnosis  of  organizational  functioning 
and  for  the  correction  or  improvement  of  dysfunctional  elements.  The  pro¬ 
cesses  associated  with  Organizational  Competence  can  be  operationally  de¬ 
fined  and,  once  made  operational ,  they  provide  concrete  bases  for  assess¬ 
ment  and  improvement  of  unit  functioning. 

The  results  of  this  research  indicate  that  the  Organizational  Effective¬ 
ness  Staff  Officer  can  be  an  effective  instrument  for  using  the  conceptual 
framework  to  assess  and  improve  unit  functioning.  CESCs  are  trained  to 
think  about  military  units  in  systems  terms,  and  by  virtue  of  their  OE 
training,  they  possess  the  skills  needed  to  establish  effective  relation¬ 
ships  with  unit  commanders  and  to  maintain  the  appropriate  consultative 
perspectives  while  providing  feedback  based  on  the  results  of  their  obser¬ 
vations  and  assisting  commanders  to  effect  changes  in  what  could  be  extremely 
sensitive  areas  of  their  organizations.  The  training  and  experience  pos¬ 
sessed  by  competent  OESOs  makes  it  possible  to  train  them  in  the  concepts 
of  Organizational  Competence  and  the  skills  required  for  assessment  of 
process  performance  with  a  minimum  of  time,  effort,  and  reorientation  of 
their  usual  approaches  to  organizational  change.  The  only  requirements 
are  (a)  a  shift  in  emphasis  from  maintenance  (quality  of  life)  processes, 
which  is  the  predominant  focus  of  current  OE  activities,  to  the  conversion 
(operational)  processes  associated  with  Organizational  Competence,  and 
(b)  development  of  skills  in  observing  and  assessing  ongoing  activities 
in  a  combat  environment.  In  passing,  it  is  worth  noting  that  Organizational 
Competence  applies  equally  to  garrison  environne: • s  and  noncombat  organi¬ 
zations,  and  attention  to  operational  processes  in  these  contexts  can  be 
expected  to  prove  as  useful  as  in  combat  units. 

The  OESOs  who  participated  in  the  research  reported  here  were  able  to 
learn  the  concepts,  develop  the  skills,  and  make  the  transition  to  a  com¬ 
bat  environment  rather  painlessly.  To  be  sure,  the  individuals  involved 
were  experienced  as  combat  arms  officers  and  possessed  outstanding  experi¬ 
ence  and  maturity  as  OESOs.  However,  there  is  no  reason  to  believe  that 
the  average,  competent  OESO  could  not  acquire  the  required  knowledge  and 
skills  when  provided  reasonably  effective  training  conducted  by  knowledge¬ 
able  instructors.  In  addition  to  these  knowledges  and  skills,  the  one 
major  requirement  for  effectiveness  appears  to  be  the  ability  of  the  OESO 
to  establish  credibility  with  members  of  command  groups  and  battle  staffs. 
This  will  be  most  easily  accomplished  if  the  OESO  is  a  combat  arms  quali¬ 
fied  officer. 
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Recommended  PESO  Training 


Training  intended  to  equip  OESOs  with  full  capabilities  for  assessing 
process  performance  and  assisting  commanders  to  improve  process  performance 
of  their  units  should  include  the  following: 

1.  Review  of  organizations  as  systems  and  of  systems  theory  concepts 
with  emphasis  upon  adaptability  to  external  changes,  conversion 
processes,  and  relationships  between  maintenance  processes  and 
conversion  processes  in  organizational  systems. 

2.  Concepts  of  Organizational  Competence  and  its  associated  processes, 
to  include  definitions,  relationships,  applications  to  military 
combat  and  nonconbat  organizations,  and  evidence  of  relevance  for 
military  organizations. 

3.  Procedures  for  operationally  defining  and  identifying  the  FORGE 
organizational  processes  in  operational  contexts  and  organizations. 

4.  Procedures  and  instruments  for  observing  and  assessing  process 
performance  in  combat  and  noncombat  organizations  and  contexts. 

5.  Procedures  for  providing  feedback  on  process  observations  and  as¬ 
sessments  to  commanders  and  other  unit  members. 

6.  Strategies  for  improving  process  performance. 

The  concepts  and  background  will  have  to  be  presented  through  lecture 
and  discussion  methods.  However,  it  is  recommended  that  such  procedures 
be  ke: c  tc  a  minimum  and  that  heavy  emphasis  be  placed  upon  practical  exer¬ 
cises  and  other  experiential  methods.  If  at  all  possible,  participation 
and/or  observation  in  a  battle  simulation,  or  mini-simulation,  is  strongly 
recommended. 


Training  for  Command  Groups  and  Battle  Staffs 

The  finding  that  the  quality  of  process  performance  is  related  to  bat¬ 
tle  simulation  outcomes  leads  to  the  conclusion  that  training  command  groups 
and  battle  staffs  to  improve  their  performance  of  the  fundamental  opera¬ 
tional  processes  will  contribute  to  enhanced  combat  readiness  of  tactical 
units.  Although  the  findings  of  this  research  are  limited  to  command 
groups,  i.e.,  to  battalion  commanders  and  their  staffs,  the  concepts  of 
Organizational  Competence  and  its  associated  processes  apply  to  the  entire 
command  and  control  system  of  a  unit,  and  much  of  the  dysfunction  in  pro¬ 
cesses  occurs  in  the  interaction  and  flow  of  communication  between  levels 
within  an  organization.  Accordingly,  maximum  unit  effectiveness  can  be 
expected  only  when  personnel  at  all  levels  are  equally  proficient  in  per¬ 
formance  of  the  processes  and  their  separate  activities  are  integrated  into 
a  unified  system  of  decision  and  action.  In  short.  Organizational  Compe¬ 
tence  involves  both  individual  process  proficiency  and  teamwork  among  all 
levels  of  a  unit.  Such  proficiency  and  teamwork  is  best  accomplished 
through  systematic  training. 
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The  obvious  choice  for  implement ing  such  training  is  the  Organiza¬ 
tional  Effectiveness  Staff  Officer.  The  research  reported  here  has  demon¬ 
strated  that  OESOs  are  able  to  learn  the  relevant  conceptual  framework 
and  can  be  trained  to  understand,  assess,  and  provide  feedback  on  obser¬ 
vations  concerning  process  performance  within  combat  units.  Accordingly, 
it  appears  to  be  entirely  feasible  to  develop  instructional  procedures 
which  would  use  the  training,  experience,  and  capabilities  of  OESOs  as 
the  basis  for  providing  experience-based  training  to  command  groups  and 
battle  staffs.  Of  course,  such  training  would  remain  under  the  control 
of  TOE  unit  commanders .  However,  initial  formal  training  would  involve 
OESOs  as  trainers,  cor.-ultants ,  process  observers,  and  resource  personnel. 
It  would  Le  expected  that,  eventually,  process  practice  and  assessment 
would  become  an  ongoing  unit  activity,  conducted  by  unit  personnel. 

Following  are  recommendations  for  implementation  of  process  training 
for  TOE  unit  personnel: 

1.  Training  should  be  capable  of  being  conducted  locally  by  TOE 
unit  personnel  assisted  by  ar.  OESO  who  has  been  instructed  in 
procedures  for  conducting  such  training. 

2.  Insofar  as  is  feasible,  training  should  be  experiential,  i.e.  ,  it 
should  provide  participants  experience  in  performing  processes 
under  controlled  conditions,  assessing  their  performance,  and 
practicing  ways  of  improving  performance. 

3.  Emphasis  in  training  should  be  upon  the  performance  of  processes 
rather  than  identification  of  them  (as  in  training  for  OESOs) . 

4.  Training  should  emphasize  coordination,  teamwork,  and  exchange 
of  information,  in  addition  to  performance  of  the  separate 
processes. 

5.  Training  should  provide  opportunity  for  role  identification  and 
role  clarification  in  relation  to  performance  of  the  various 
processes. 

6.  Training  should  include  a  short  block  of  instruction  concerned 
with  the  potential  role  of  OESOs  as  process  observers  and  with 
the  utility  and  use  of  OESO  feedback  in  field  training  exercises, 
CPXs,  etc. 

7.  Insofar  as  is  administratively  feasible,  training  should  include 
participation  in  a  battle  simulation,  with  process  assessment 
and  feedback  conducted  periodically  by  OESOs . 

8.  For  the  training  to  be  maximally  effective,  a  full  training 
program  should  be  designed  and  developed,  to  include  procedures 
to  be  used  by  OESOs  in  conducting  the  training,  all  materials  to 
be  used  during  training,  and  detailed  guidance  for  conducting  the 
training. 
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APPENDIX  A 


PROCESS  PERFORMANCE  ASSESSMENT 


SENSING 

-  Was  all  information  available  to  the  organization  obtained  by  it? 

-  Were  attempts  to  obtain  information  relevant  and  effective? 

-  Was  correct  interpretation  placed  upon  information  that  was  obtained? 

-  In  view  of  the  information  available  to  the  organization,  was  a 

correct  assessment  made? 

-  Was  sensing  performed  effectively  at  all  levels? 

COMMUNICATING  INFORMATION 

-  Was  information  sensed  by  the  organization  communicated  to  everyone 

who  needed  it  when  they  needed  it? 

-  Was  communication  of  information  complete,  accurate,  and  timely? 

-  Was  communication  of  information  efficient? 

DECISION-MAKING 

-  Was  all  relevant,  available  information  used  in  decision-making? 

-  Were  decisions  made  at  each  level  correct  in  view  of  information 

available  to  decision-makers? 

-  Were  decisions  timely? 

STABILIZING 

-  When  decisions  were  made,  were  their  potential  effects  upon  the 

organization  taken  into  account  and  action  taken  to  counter  any 
negative  effects? 

-  Were  internal  operations  or  organizational  arrangements  adjusted 

appropriately  to  accommodate  to  new  decisions? 

COMMUN I CAT  I NG  I MPLEMENTAT I ON 

-  After  decisions,  was  communication  about  implementation  requirements 

complete,  accurate,  and  timely? 

-  Was  everyone  informed  about  implementation  decisions  and  requirements 

that  should  be  informed? 

COPING  ACTIONS 

-  Was  execution  of  actions  correct  and  effective? 

-  Were  all  actions  leading  from  decisions  actually  carried  out? 

FEEDBACK 

-  Was  action  taken  to  obtain  information  about  the  outcomes  of  actions 

and  decisions? 

-  Was  information  obtained  in  follov-up  used  to  modify  activities  or 

make  new  decisions? 


25 


APPENDIX  B 


PROCESS  DEFINITIONS  AND  CRITERIA 


hroceaa 

' 

Oaim.tion 

[ - 

IOa*tif»cei'On  Cntwa 

f—uauon  C' »!**•» 

Sfnsing 

l  Tha  ad  w  >ntor 

—no«  from  m  c— earning 
any  amuo— t  of  tha 
organization. 

\  An,  K»  by  a  player  of  receiving,  obtain  | 
|  mg,  oi  ittem^ing  *o  obtain  mforma  j 

manon.  ordars.  <nstructions.  or 
j  recommendations  from  someone  or 
i  something  outside  of  tha  simulated  1 

1  a'ae'wjtion  May  involve  passive  I 

1  Accurst*  dttsction  si  ttl  must 
information. 

2.  Correct  miarst station  si  oil  tfttsetss 
mis  rmttioa.  to  UK  tut*  tfpretritu 
tatigtiwn  ad  m  its— rtawes. 

t 

rturt<  of  informs  not  mm;  hour  initiative 
rq  itinm  •»  v  m#v  active 

1  attempt  to  obtain  inuxmation 

|  2.  involves  player -controller  interaction  in 

3.  Accurate  discrimination  bat— on  relevant 
and  inafavant  information. 

|  4.  Attempts  to  obtain  information  art 
relevant  to  rnnoon,  task,  or  probftm. 

any  mode. 

3.  in  gamma  simulations  where  company 
commander  engagot  in  board  play  os  a 
"p(ay«r/controH«r,“  Sarong  mciodas 
company  commandtr's  “racaipi'*  of 
information  from  tha  board,  ».a..  bit 
saosmg  of  board  play. 


5.  Strong  activities  art  timely  m  rotation  to 
information  requirements  and  the  roc  teal 
situation. 


Communicating 

Information 


Thosa  activities  through 
which  information  which  has 
boon  sonstd  by  somt 
representative  of  tht 
organization  n  madt  available 
to  rhosa  who  most  set  on  it 
or  makt  daemons  about  it. 


1.  Transmission  and  discussion  of  infor¬ 
mation  by  player  j  after  it  has  baan 
sonsad  and  befora  a  daemon  has  baan 
mada  about  it. 

2.  May  pass  through  several  links 
batwaan  sensing  parsonnai  and 
daemon  makers. 

3.  Player-player  intaroction.  axcept 
whara  piayar  informs  Bright  con- 
trollars  or  subordmata  unit  con- 
trooilars  and  information  sansad. 

♦  May  mvolv*: 

a.  initial  transmittal  of  information 
by  sarong  individual. 

b.  Pitting  on  of  information  by 
linking  parsonnai. 

c.  Dissammation  of  information 
throughout  organization 

d.  Discussion  and  mtarpretation- 
Discussiofl  for  clarification  or 
implication. 

S.  Includts  communication  of  rocom- 
mandations  from  subordinate  units. 


Accuracy  of  transmission  of  avti labia 
information. 

2.  Sufficiantty  compiatt  to  transmit  full  and 
adequata  undarstandmg  to  tha  receiver 

3.  Timaimass  appropriata  to  unit  requirements 

4.  Correct  choica  of  racipionts. 

5.  Whathar  message  should  have  baan  commu¬ 
nicated. 


I. 


(Continutdl 


Otcwon 

Mak.ng 


Deliberative  activities  o*  on*  or 
mon  ptfiont  leading  to  a  con¬ 
clusion  that  som*  action  will, 
as  dMuid.  be  f«k#n  by  the  organ¬ 
ization  Usually  eartonced  tv 
th«  mit»  rwm»Mtrfi«  o» 
the  doc w on  by  \M  daemon 
maker.  The  conwnrucua*  may 
toko  the  form  of  announcement 
of  t ft*  daemon,  i  command .  an 
ordar.  or  metruction*  Deci¬ 
sions  may  laad  to  Active  Sens¬ 
ing,  formal  Sensing  Action*. 
Stabilizing  Action*.  Coping 
Action*,  or  Feedback  Action*. 
Daemon  making  includes  deci¬ 
sions  to  rasemd  decisions.  Qeci- 
sion  making  u  not  limited  to 
commanders,  it  may  include  all 
pfayer*. 


A  communication  of  some  sort 
reflecting  the  intention  to  take  some 
kind  of  action 

Mort  often,  the  first  evidence  that 

a  daemon  a**  aeon  nude  w#  da  a 

command,  order,  or  iitstructioa 
(on*  or  written  I  issued  by  the 
daemon  maker. 

Usually  player-player  interaction; 
but  at  lower  boundary  of  simu¬ 
lated  orgemution,  may  involve 
player-controller  interaction. 

In  Pegasus,  the  only  evidence  of  a 
decision  made  by  a  company  com¬ 
mander  may  be  his  interaction 
with  the  game  board,  i.a.,  his 
movemenr  of  pieces  on  the  board 
(this  would  be  a  combination  in  one 
activity  of  decision  making  and 
coping  action). 


Stabilising 


Actions  intended  to  ad|ust 
internal  operations,  maintain 
internal  stability  or  unit 
integrity,  or  prevent  dis¬ 
ruption*  and  negative  ode 
effects,  as  a  consequence  of 
coping  action*.  All  action* 
intended  to  prevent  potential 
negative  effects  to  the  organi¬ 
zation  which  might  occur 
because  of  Coping  Action*. 


1  Playar/player  interaction. 

2.  Limited  to  actions  specifically 
intended  to  moderate  the  potential 
ode  effects  of  Coping  Actions  or 
to  sdiutt  internal  organization  or 
operations  necessitated  by  the 
potential  effects  of  a  Coping 
Action. 


Communicating 

Implementation 


Those  activities  through  which 
daemon*  and  requirements 
resulting  from  daemons  are 
communicated  to  those  individ¬ 
uals  or  units  who  must  imple¬ 
ment  the  decision*.  Inciudis 

(1)  transmission  of  ordars 
or  instructions  and 

(2)  “dteusion  and  inter- 
prttation-thosa 
communications  through 
which  clarification  is 

achieved  and  implications 
for  action  art  discussed 
Includes  ail  communica¬ 
tion  link*  between  decision 
maker  and  final  implemented 
of  decision. 


1.  Player/player  interaction. 

2.  Occurs  after  decision  end  before 
action. 

3.  Includes  orders,  instructions,  and 
discussion  of  them  and  their  impli¬ 
cations.  including  clarification  and 
attempts  to  obtain  clarification. 

4.  Limitad  to  communication  abino 
actions  to  ba  taken 

5.  May  pas  through  several  links 
between  decision  maker  and  executor 
of  action 


>  (Continued)  - 


Adequecy-Was  the  decision  adequately 
correct  m  mew  of  circumstances  and 
tirtormtfeoft  available  to  the  decision 
maker? 

Appropriateness -Was  the  dacision  timely 
m  view  of  the  information  available  to  the 
daemon  maker ' 

Compfttenoi-Oid  the  decision  take 
into  account  all  or  most  contingencies, 
efternatives,  and  ptmibilities? 


Adequacy -Action  is  correct  in  view  of 
the  operational  situation  and  the  decision 
on  order  from  vrtiich  the  action  derived. 

Appropriateness- Timing  is  appropriate  in 
mew  of  otuation  and  the  decision  or 
order  from  which  it  derived.  Choice  of 
recipient  of  the  action  is  appropriate. 

Completeness-Action  fully  implements  the 
decision  from  which  it  derived  or  fully 
meets  the  requirements  of  the  situation. 


Accuracy  of  transmission  of  instructions. 

Sufficient  completeness  to  transmit 
adequate  and  full  understanding  of  actions 
required. 

Timely  transmission  in  view  of  both  evailabte 
information  and  the  action  requirements  of 
participant*. 

Transmission  to  appropriate  recipient* 

Whether  message  should  have  been 
communicated. 
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Ot*>n»»*on 


Identification  Criteria 


Evaluate*  Criteria 


Coping  Action* 


Ths  proem  of  executing  actions 
against  target  environments. 
Primarily  concerned  with 
execution  and  with  how  actions 
art  cam  ad  out. 


1.  Pia-.*'  ce^roiiar  interaction. 

2  Actions  u*  at  \tve  o-  r.i  of  contact 
with  targw  an*  r*"merts  f  p  »r 
boundaries  of  simulated  o/pn/tafion 

3.  Actions  to  "do  something  to”  the 
extarnai  environment.  to  chenga 
or  cooa  with  the  targat  environment. 

I  u« ts  "’Ot  include  actions  to  obuw* 


1.  Correctness  of  action  m  v«w  of  both  tha 
operational  circumstance  and  tha  deci¬ 
sion  or  order  from  which  tha  action 
danvts. 

2.  Timatmm  of  tha  action  in  via*  of  both 
operational  circumstance  and  tha  daemon 
or  ordar  from  which  tha  action  derives 

3.  Correctness  of  choice  of  target  of  the  action. 

4  Adequacy  of  execution  of  action. 


5.  In  battle  simulations,  coping  actions 
may  taka  form  of  orders  or  maruc 
tun  *o  «4ordmet«  units  pity  ad  by 
controllers. 

6.  In  battle  simulations  whan  company 
commander  <s  a  player /controller 
interacting  with  a  game  board,  coping 
actions  an  his  amotion  of  the  board 
P*»V 


Activities  that  assist  tha 

1  format  actions  taken  to  obtain  mfor 

organization  to  amfuata  tha 

motion  about  the  results  or  effects  of 

affactwanass  of  itt  actions 

Coping  Actions. 

and  dial  prowda  information 
upon  which  adjustment!  and 

2  nayar/tomrbllar  interaction  only. 

future  action!  can  be  baaed. 

3  Should  be  preceded  by  an  organize- 

tionar  daemon  to  initiate  a  feedback 

action 

Feedback 


1 .  Correctness  of  tha  action  in  view  of  both 
the  operational  circumstance  and  tha 
decision  or  ordar  from  which  the  action 
derives. 

2.  Tim*tmt»  of  tha  action  in  view  of  both 
tha  opantionat  circumstances  and  tha 
decision  or  ordar  from  which  tha  action 
derives. 

3.  Correctness  of  choice  of  target  of  the  action. 

4  Adequacy  of  execution  of  tha  action. 


APPENDIX  C 


Battalion  Identification 


Module  No.  _ 

Type  of  Operation 
Rater 


SUMMARY  PROCESS  ASSESSMENT  FORM 


This  form  is  to  be  completed  at  the  end  of  each  PEGASUS  module. 
Use  the  scale  shown  below  to  rate  the  overall  performance  of  the 
battalion  players  (battalion  command  group  and  company  commanders) 
as  a  unit  on  each  of  the  listed  processes  during  the  module.  Use 
the  scale  to  select  the  description  that  best  fits  your  assessment 
of  the  battalion's  performance  of  the  process  being  rated.  Enter 
in  the  space  preceding  each  process,  the  number  of  the  descriptor 
that  best  fits  your  assessment. 


Scale 

4  -  Excellent 
3  -  Adequate 
2  -  Marginal 
1  -  Poor 


Rating  Process 


Sensing 

Communicating  Information 
Decision  Making 
Stabilizing 

Communicating  Implementation 

Coping  Actions 

Feedback 
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APPENDIX  D 


Battalion 


Controller  Position 


CONTROLLER  RATING  FORM 


Please  rate  the  battalion  indicated  above  on  each  item  below.  For 
each  item,  make  your  judgment  according  to  the  combat  outcome  of  the 
exercise.  Do  not  rate  the  performance  of  the  command  group  alone.  In¬ 
stead,  rate  the  battalion,  as  a  whole,  in  terms  of  its  combat  results. 

If  several  types  of  operations  were  conducted,  e.g.,  attack,  defense,  etc., 
and  the  unit  did  better  on  some  operations  than  others,  base  your  ratings 
on  your  overall  impression  of  all  of  the  combat  results  achieved  by  the 
unit.  For  each  item,  place  an  "X"  on  the  scale  point  that  represents 
your  best  judgment. 


1.  Rate  the  extent  to  which  the  battalion  accomplished  its  mission 
stipulated  in  the  Brigade  OPORD,  including  any  changes  subsequent  to  the 
initial  OPORD. 


5 


Mission 
requirements 
were  not 
met  in  any  way 


Unit  was 

reasonably  effective 
in  view  of 
circumstances 


Mission  was 
accomplished 
in  all  respects 


2,  Rate  the  extent  to  which  area,  or  geographical  objectives,  was 
controlled  by  the  battalion  in  accordance  with  its  mission,  to  include 
any  time  schedules  stipulated  in  its  mission  for  holding  areas  or  taking 
objectives. 


1 


2 


5 


Mission  area 
requirements 
were  not 
met  in  any  way 


Mission  require¬ 
ments  were  only 
partly  met  with 
respect  to  control 
of  area 


Control  of  area 
was  in  full 
compliance  with 
mission  require¬ 
ments,  including 
time  schedules 
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( 


3.  Rate  the  expenditure  of  resources  (personnel,  weapons,  equip¬ 
ment)  by  the  battalion.  (For  this  item,  do  not  consider  ratio  of 
friendly  to  enemy  losses.  Rate  only  in  terms  of  the  condition  of  the 
battalion  at  the  end  of  the  exercise  or  operations.) 


J _ 

1 

[  -i  .  . 

2  3 

1 

4 

1 

5 

Resources 

Resources 

Remaining 

remaining 

remaining 

strength  such 

make  unit 

are  not  more 

that  operation 

ineffective. 

than  75  nor  less 

can  be  continued 

Should  be 
replaced. 

than  60  percent. 

without  interruption 

4.  Rate  the  expenditure  of  resources  (personnel,  weapons,  equipment) 
by  the  battalion  in  relation  to  losses  of  resources  by  the  threat  forces 
opposing  it,  i.e.,  the  ratio  of  friendly  to  threat  losses  of  resources. 


3 


4 


Loss  ratio 
is  totally  in 
favor  of 
threat  forces. 


Losses  were 
balanced  equally 
between  threat 
and  friendly  forces. 


Loss  ratio 
is  totally 
in  favor  of 
friendly  battalion. 


5.  Rate  the  overall  combat  effectiveness  of  this  battalion  in  the 
exercise. 


3 


4 


5 


Totally 

ineffective 


Minimally 
adequate 
for  mission 
accomplishment. 


Effectiveness 
exceeded 
mission 
requirements . 
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